This team has decades of practical experience in working with Java and with billions of rows of data. If you are an analyst or a data scientist, you're used to having multiple systems for working with data. With Spark, you have a single engine where you can explore and play with large amounts of data, run machine learning algorithms and then use the same system to productionize your code. Scala: Scala is a general purpose programming language - like Java or C . It's functional programming nature and the availability of a REPL environment make it particularly suited for a distributed computing framework like Spark. Analytics: Using Spark and Scala you can analyze and explore your data in an interactive environment with fast feedback.